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LWIR  Airborne  Sensor 


Signal  Innovations  Group,  Inc. 


Three-Band  Data  from  SCISSOR 
(Shadow-Class  Infrared  Spectral  SensOR) 


•Three  bands  chosen  within  and  just  outside 
the  Restrahlen  band. 

•SCISSOR  data  collected  using  a  helicopter 
flyover. 

•Buried  targets  marked  by  fiducials  including 
pressure  plates,  155  rounds,  and  empty  holes. 
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Area  of  study 
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Set  of  fiducial  marked  targets,  including  14  pressure  plates 


Image:  scan_1500_20_off_cm_EW_runl_090723_063623_rad_mfilt_median_3band_12600-14700_TRIGEO_rotreg_merge_geomerge.xv 
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Data 


Scatter  Plot  of  Whitened  Radiance 


Spectral  features  are  not  enough  to  clearly  separate  targets  from  background 
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Objectives 
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*  Maximize  detection  of  buried  targets  while  minimizing 
false  alarms. 

*  Explore  a  variety  of  RX-family  detectors  that  could  be 
useful  for  buried  target  detection  within  varying 
background  complexities. 

*  Provide  an  overall  framework  for  buried  target 
detection  using  a  combination  of  anomaly  detection 
followed  by  spectral  and  spatial  feature  classification. 
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Overall  Approach 


Features:  Spectral  and  relative  spatial 
information 


Image  segmentation  to  find  regions  of 
interest  (ROIs)  using  a  variational 
Bayesian  Gaussian  mixture  model. 


Classification  of  each  ROI  as  a  target 
or  clutter  using  a  relevant  vector 
machine  (RVM). 
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Overall  Process 


Spectral  and  Spatial  Features 


ROI  Features 


RX  GMMRX 
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Target  classification 
using  RVM 


2 


Spectral  Features 

2  Bands  of  emissivity  and  temperature  (emissivity  normalization  method) 


Emissivity  Band  1 


3  Radiance  Bands 
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Spatial  Features:  Gradient  (Sobel)  and 
Size/Shape  Template^^^^_ 


Sobel  operator  with  template  matching 


Edge  detection  with  Sobel  operator 


Annular  template  matching  on  the  Sobel  image 


Step  1  Step  2 

A  Sobel  operator  is  used  on  the  spectral  data  to  find  edges  within  the  image,  revealing  the  buried 
targets  as  rings.  An  annular  template,  the  size  of  the  target  rings,  is  applied  to  the  Sobel  image, 
providing  a  final  image  displaying  where  the  centers  of  the  rings  are  (likely  target  locations). 
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Spatial  Anomaly  Measure:  RX  family 


•  Standard  RX  anomaly  detector  assumes  that  points  in  context 
region  are  from  a  multivariate  Gaussian  density 


RX  =  \X  —  X  f  v_1  (v  —X  ) 

inner  context)  ^  context  inner  context) 


This  assumption  is  violated  when  the 
local  context  region  is  abruptly 
changing  or  composed  of  multiple 
types  of  background  signals 

NEW  APPROACH:  Model  context 
region  pixels  with  a  Gaussian  mixture 
model  using  local  and  global  context 


context  region 
guardband  region 

test 
pixel 

inner  region 


-  Use  a  variational  Bayesian  Gaussian  mixture  model  (GMMRX)  to  learn 
clusters  globally  for  an  entire  image 


-  Use  globally  learned  clusters  to  create  local  GMMs  (local  GMMRX)  for  each 
context  region 
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Comparison  of  approaches 


RX 

GMMRX 

Local  GMMRX 

Min  Local 
GMMRX 

Strengths 

Detecting  anomalies  in 
relatively  smooth,  well- 
behaved  regions 

Detecting  anomalies  in 
relatively  smooth,  well- 
behaved  regions 
(usually) 

Detecting  anomalies  in 
rapidly  varying 
background 

Detecting  anomalies  in 
smooth  regions 

Detecting  anomalies  in 
rapidly  varying 
background 

Detecting  anomalies 
that  differ  from  at  least 
some  local  context 
clusters 

Detecting  anomalies  in 
smooth  regions 

Detecting  anomalies 
that  differ  from  all  local 
context  clusters 

Weaknesses 

Detecting  anomalies  in 
rapidly  varying 
background 

Detecting  anomalies 
that  do  not  differ 
substantially  from 
globally-learned 
parameters  (even  if 
they  are  noticeably 
different  from  local 
context  pixels) 

May  detect  more 
unwanted  anomalies 
since  any  anomaly  that 
differs  from  at  least 
some  local  context 
clusters  will  be 
detected 

Detecting  anomalies 
that  differ  from  some 
local  context  clusters 
but  not  all  (can  cause  a 
problem  when  trying  to 
detect  anomalies  in 
rapidly  varying 
background) 

11  February  2010 


SIGNAL  INNOVATIONS  GROUP 


11 


Spatial  Features:  RX  family 


I 

RX  GMMRX 


Local  GMMRX 


Min  Local  GMMRX 
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RX  Performance 


RX  detector  only,  not  with  the  comprehensive  detection  process. 


All  Target  Types 

Anomaly  detector  performance  (VBG>^*I  vtf  flduc'da) 


Pressure  Plates  Only 

Anomaly  detector  performance  (VBGhM  wf  lldudab) 


10 

FAR(stamrnfty) 


10 

FAR  (ak 


Since  they  perform  the  best,  the  standard  RX  and  the  Min  GMMRX  are  both  used  as  features  in 
the  overall  target  detection  process  described.  Min  GMMRX  is  referred  to  as  GMMRX  in  the 
remainder  of  the  slides  for  convenience. 
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Unsupervised  clustering 


using  VBGMM 


2D  data  sampled  from  4  Gaussians  4  VBGMM  non-zero  VBGMM  clusters 

mixture  components 


•  The  number  of  clusters  is  determined  by  the  algorithm. 

•  Complex  models  are  penalized,  guiding  the  algorithm  to  choose  the  best  fit  using  the  least 
number  of  clusters. 

Pm  [?]  -  /  mwm  tee  -  toe -  »£bwi  b*W3 
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Features  used  for  VBGMM  image  segmentation 


*  Spectral  Features(E2,  E3,  T) 
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*  Spatial  Features  (Sobel  with  Template  Matching,  RX) 
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Image  segmentation  using  VBGMM 


Regions  of 
Interest 
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Groups  of  brown  pixels  designated  as  regions  of  interest  (ROI). 
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Feature  2 


Relevance  Vector  Machine 


2 


RVM  functional  form  is  kernel-space  hyperplane  classifier :  /(x)  =  wr(|)w(x) 


Bayesian  learning:  prior  on  weights  to  induce  sparse  solution  (i.e.,  most  weights  driven  to 
zero)  -  learn  weights  by  maximizing  posterior 


P(w\f,y)  x  p(y\f,w)  p(w) 


Likelihood’s  Desire 
to  Fit  Data 


Prior’s  Desire  For 
Sparse  Solution 


Posterior  Balances  these  Objectives 


Vv4 
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Feature  1 


Example  -  Automatic  relevance  determination  (ARD) 

-  Adopt  hierarchical  Bayes  model  -  zero-mean  Gaussian  prior 
with  exponential  hyper-prior  on  independent  variances,  t; 

p(wi  I TI )  =  N(w<  I  °>  Ti )  p(?i  I  r)  =  (; r / 2)  exp  {-  / 2} 

-  Integration  with  respect  to  t,-  recovers  Laplacian  form 

•  Allows  for  expectation-maximization  (EM)  iterative  optimization 

oo 

P(Wi  I  r)  =  \ pi^i  I  ri)p{Ti  I  y)dzl  =  (r/ 2) exp {-Vr |^- 1) 
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ROI  Features  used  with  RVM 


Emissivity  Band  2 


RVM  Feature  2 


Mean  Intensity  of  Temperature 


RVM 


2-Dim.  RVM 
classification  map 
(White  areas  are  regions 
of  low  uncertainty) 


Clutter  Region 


Target  Region 
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ROI  classification  using  RVM 
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Each  ROI  is  classified  as  target  or  clutter  by  the  RVM. 
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Results  on  pressure  plate  detection 


Pressure  Plate  Detection 
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False  Alarms  per  linear  km 

Image:  scan_1500_20_off_cm_EW_runl_090723_063623_rad_mfilt_median_3band_12600-14700_TRIGEO_rotreg_merge 
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Results  on  155  round  detection 


E 


155  Round  Detection 


Image:  scan_1500_20_off_cm_EW_runl_090723_063623_rad_mfilt_median_3band_12600-14700_TRIGEO_rotreg_merge_geomerge.xv 
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Results  empty  hole  detection 


Image:  scan_1500_20_off_cm_EW_runl_090723_063623_rad_mfilt_median_3band_12600-14700_TRIGEO_rotreg_merge_geomerge.xv 
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Results  on  pressure  plate,  155  round, 
and  empty  hole  detection 

Pressure  Plate,  155  Round,  and  Empty  Hole  Detection 
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False  Alarms  per  linear  km 

Image:  scan_1500_20_off_cm_EW_runl_090723_063623_rad_mfilt_median_3band_12600-14700_TRIGEO_rotreg_merge_geomerge.xv 
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Summary 

The  comprehensive  approach,  using  both  spectral  and  spatial 
features,  VBGMM  for  image  segmentation  to  find  ROIs,  and  RVM  to 
classify  ROIs  that  are  targets  works  far  better  than  the  windowed  RX 
detector  alone  in  detecting  buried  targets. 

Pressure  plates  are  the  target  best  detected,  and  the  155  rounds  are 
the  most  difficult  to  detect. 

GMMRX  as  a  feature  used  in  the  comprehensive  approach 
performs  best  at  higher  probability  of  detection  levels,  particularly 
when  restricting  the  search  zone  only  to  the  road. 

In  a  setting  where  targets  are  placed  within  a  more  heterogeneous 
background  (i.e.,  off  road  or  side  of  road),  the  RX  feature  would  likely 
miss  many  more  targets  than  GMMRX,  providing  a  clear  advantage  in 
using  GMMRX. 
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Follow  On  Work 


E 


*  Improve  target  detection  by  representing  spatial 
pixel  blocks  of  spectral  data  as  a  mixture  of  base 
distributions,  and  performing  unsupervised 
clustering  using  the  Dirichlet  process. 

*  Develop  a  fully  Bayesian  approach  to  emissivity  and 
temperature  extraction  from  multiband  radiance 
data. 

*  Consider  a  noise  model  in  buried  target  detection 
within  a  fully  Bayesian  setting. 
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